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Abstract 

This  paper  considers  discrete-time  systems  with  full  state  feed¬ 
back,  scalar  control  and  scalar  disturbance.  First,  systems  with  a 
scalar  regulated  output  are  studied  (singular  problems).  It  is  shown 
that  there  is  a  large  class  of  such  systems,  characterized  by  the  non¬ 
minimum  phase  zeros  of  the  transfer  function  from  the  control  to  the 
regulated  output,  for  which  the  fj-optimal  controller  is  necessarily 
dynamic.  Moreover,  such  controllers  may  have  arbitrarily  high  order. 
Second,  problems  with  two  regulated  outputs,  one  of  them  being  the 
scalar  control  sequence,  are  considered  (non-singular  problems).  It  is 
shown,  by  means  of  a  fairly  general  example,  that  such  problems  may 
not  have  static  controllers  that  are  l\ -optimal. 

Keywords:  State  feedback  control,  BIBO  optimal  control,  Linear  opti¬ 
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1  Introduction 


Since  Dahleh  and  Pearson  ([1],[2])  presented  the  solution  to  the  l\  op¬ 
timal  control  problem,  there  has  been  increasing  interest  in  understanding 
the  basic  properties  of  such  problems  ([3], [8], [9]  and  [11])-  Considering  that 
in  the  case  of  7i2  and  'H00  optimization,  state  feedback  optimal  controllers 
have  a  very  special  structure  (i.e.  static),  it  seems  only  natural  to  ask  how 
full  state  information  affects  the  l\  optimal  solution.  In  particular,  under 
what  conditions  (if  any)  there  exist  a  static  linear  controller  that  achieves 
optimality.  This  paper  presents  results  regarding  this  question,  for  systems 
with  scalar  control  and  scalar  disturbance.  In  particular,  two  different  types 
of  problems  within  this  class  of  systems  are  considered:  a)  those  with  a  scalar 
regulated  output,  denoted  as  singular  problems,  and  b)  those  with  two  reg¬ 
ulated  outputs,  denoted  as  non-singular  problems,  where  one  of  the  outputs 
is  the  scalar  control  signal.  For  systems  in  a),  it  is  shown  that  there  exists  a 
static  controller  which  is  l\ -optimal  if  the  non-minimum  phase  zeros  of  the 
transfer  function  from  the  control  input  to  the  regulated  output  satisfy  a 
simple  algebraic  condition.  Violating  such  condition,  however,  may  result  in 
a  dynamic  £i-optimal  controller  of  possibly  high  order  (generally  when  the 
non-minimum  phase  zeros  are  “close”  to  the  unit  circle).  For  systems  in  b),  it 
is  shown  by  means  of  a  general  example  that  optimal  controllers  are  dynamic 
in  a  broad  class  of  cases  which  are  common  in  control  design. 

The  paper  is  organized  as  follows.  Section  2  formulates  the  singular  prob¬ 
lem  along  with  some  basic  notation.  Sections  3  and  4  present  results  corre¬ 
sponding  to  singular  problems  involving  minimum  and  non-minimum  phase 
plants  respectively.  Section  5  examines  a  non-singular  problem  by  means  of 
a  general  example,  followed  by  the  conclusions  in  Section  6. 


2  Problem  Formulation 

Consider  the  following  state-space  minimal  realization  of  a  full  state  feed¬ 
back  system  with  scalar  inputs  w  (disturbance)  and  u  (control),  scalar  regu¬ 
lated  output  z,  and  measurements  x  (state  vector): 
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where  A  G  RnXn ,  bx  and  b2  G  i2nXl,  cj  G  Rlxn,  and  di2  G  R.  For  any 
internally  stabilizing  controller  k,  let  <j>  =  {<^(0),  <£(1),  <t>{2), . . .}  denote  the 
closed-loop  pulse  response  sequence  from  w  to  z.  Then,  the  problem  can  be 
stated  as  follows: 


inf 

k—stab. 


(l) 


where  [^Hj  =f  |</>(z)|.  Using  standard  results  in  the  parameterization  of 
all  stabilizing  controllers  (see  [6]),  problem  (1)  can  be  rewritten  as  follows: 


inf  ||U  -t2*<?*t3||1  (2) 


where  l™Xn  indicates  the  space  of  all  m  x  n  matrices  with  entries  in  lx  and  * 
denotes  convolution.  Thus,  t\  and  t2  G  t\,  and  t3  G  .  Let  the  A-transform 
of  a  right-sided  real  sequence  h  =  /t(  1 ) ,  h( 2), . . .}  be  defined  as 

h(  A)  = 

fc=0 

where  A  represents  the  unit  delay.  Then,  a  state-space  realizations  for  tx,  t2 
and  t3  can  be  found  by  using  the  state-space  formulas  in  [6]  with  the  observer 
gain  matrix,  H,  equal  to  —  A.  For  this  specific  choice,  the  realizations  are: 


MA)  = 

A  [Af,  A  bx,  Ci  +  dX2f ,  ci&i] 

(3) 

^(A)  = 

[Af,b2,cx  +  d\2f,dX2] 

(4) 

hW  = 

[0,  6i ,  J,0]  -  \  bx 

(•5) 

where  £;( A)  denotes  the  A-transform  of  i, ,  Af  =f  A  +  b2  /, 

[A,  B,  C,  D)  =f  A  C  (/  -  A  Ay1  B  +  D 

and  /  is  chosen  such  that  all  the  eigenvalues  of  Af  are  inside  the  unit  disk. 
The  following  result,  which  will  be  needed  in  the  next  section,  is  proved 

in  W' 

Theorem  2.1  Assuming  t2(-)  and  t3(-)  have  no  left  and  right  zeros  respec¬ 
tively  on  the  unit  circle,  there  exists  qopt  G  xn  that  achieves  the  optimal 
norm  in  problem  (2).  Moreover,  the  closed-loop  optimal  pulse  response, 
4>oPt  =  tx-t2*  qopt  *  t3,  has  Unite  support. 
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3  Singular  Problem  with  Minimum-Phase 

Plant 


This  section  considers  the  case  where  the  transfer  function  from  the  con¬ 
trol  input,  u ,  to  the  regulated  output,  z,  is  minimum-phase  except  for  an 
integer  number  of  unit  delays  (i.e.  zeros  at  the  origin  in  the  A-plane).  It  will 
be  assumed  throughout  that  (A,b2)  is  reachable. 

Theorem  3.1  For  such  a  system ,  the  static  feedback  gain,  /*,  that  places 
the  eigenvalues  of  {A  +  b2  /*)  at  the  exact  location  of  the  minimum-phase 
zeros  of  [A,  b2,  cx,  dx2]  and  the  rest  at  the  origin  is  fx  -optimal. 

Proof  Consider  using  f*  as  the  state  feedback  gain  in  the  parameteriza¬ 
tion  described  above.  Then,  after  carrying  out  all  stable  pole-zero  cancella¬ 
tions, 

i2(\)  =  lry 

where  r  is  the  number  of  unit  delays  in  [A,  b2,  cx,  d12]  and  yr  is  a  scalar 
depending  on  r.  In  what  follows,  the  cases  where  r  =  0  and  r  >  0  will  be 
treated  separately. 

i)  If  r  —  0,  then  d12  ^  0,  cx  +  d\2f*  =  0,  and  t2(X)  =  dx2.  Also,  from 
equation  (3), 

ti(A)  —  Ci  bx  A  =  ( cxbx  +  dX2f*bx  —  dX2f*bx)X  —  —dx2f*bx 
=*  &X)  = -dx2fbxX  -  dl2q{X)bxX 

Thus,  the  fi-optimal  solution  is  given  by  qopt{\)  =  — /*,  and  4>0pt{X)  =  0. 
Furthermore,  using  the  state-space  equations  in  [6]  for  computing  the  optimal 
controller,  it  can  be  shown  after  a  little  algebra  that  KPt(  A)  =  /*. 

ii)  If  r  >  0,  then  dX2  =  0,  cxArj.  =  0  by  construction,  and  t2( A)  = 
cxArf 71  Ar.  Again,  from  equation  3, 


4(A)  -  cxbx A  +  cxAbx A2  +  ClAf.Abx A3  +  •  •  •  +  cxArfl  AbxXT+1 


Therefore,  the  closed-loop  pulse  response  is  given  by 

0(A)  —  cxbxX  c\Abx X  A  cxAj*Abi A^  •  ■  ■ 

+  cxArf ~%Xr  +  c1Arf1{A  -  b2q(X))bxXT+1 
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Clearly,  q  does  not  affect  the  first  r  +  1  elements  of  (j>  (i.e.  <f>(i),i  =  0, 1, . . .  ,  r). 
Then,  the  best  possible  choice  of  q ,  in  the  sense  of  minimizing  the  ^-norm  of 
<fr,  is  the  one  that  makes  <f>(i)  =  0  for  i  —  r  +  1,  r  +  2, . . .,  and  is  achieved  by 
letting  qopt( A)  =  — /*,  since  <f>(r  -f  1)  =  CiArf.bi  =  0.  Again,  the  correspond¬ 
ing  l\ -optimal  controller  is  /*.  ■ 


Corollary  3.1  The  l\-optimal  closed-loop  transfer  function  of  the  system 
considered  in  theorem  3.1  (with  r  >  0)  is  given  by: 

Kt(\)  =  c1±Ai-1  \% 
i- 1 

Proof  It  follows  from  the  fact  that  CiAl^.b2  —  0  for  i  =  0, 1,;. . . ,  r  —  2.  The 
details  are  left  to  the  reader.  ■ 

Put  in  words,  theorem  3.1  says  that  there  is  nothing  the  controller  can 
do  to  invert  the  delays  in  the  system.  It  can,  however,  cancel  the  rest  of  the 
dynamics  of  the  system  due  to  the  absence  of  non-minimum  phase  zeros  in 
the  transfer  function  from  the  control  input  to  the  regulated  output.  This 
results  in  an  optimal  closed-loop  pulse  response  that  is  equal  to  the  open 
loop  pulse  response  in  its  first,  (r  -f  1)  elements  and  zero  thereafter.  It  is 
also  worth  noting  that  theorem  3.1  is  directly  applicable  to  the  discrete-time 
LQR  problem,  where  Yli  4>j  is  minimized.  More  precisely,  the  asymptotic 
LQR  solution  (see  [7])  where  the  weight  on  the  control  tends  to  zero  (i.e. 
cheap  control  problem)  is  identical  to  that  of  theorem  3.1. 

4  Singular  Problem  with  Non-minimum 

Phase  Plant 

This  section  considers  those  cases  where  [A,  b2,  cx,  d12]  has  r  non-minimum 
phase  zeros  not  necessarily  at  the  origin  (i.e.  A  =  0). 

Again,  we  use  the  same  parameterization  as  in  the  previous  section.  That 
is,  we  choose  f*  to  place  ( n  —  r )  eigenvalues  of  A*f  at  the  exact  location  of  the 
minimum  phase  zeros  of  [A,  b2,  ci,  di2]  and  the  rest  (r)  at  the  origin.  Then, 
from  the  discussion  in  section  3,  ti(A)  is  polynomial  in  A  and  of  order  (r  -f  1), 
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t2(A)  is  polynomial  too,  but  of  order  r,  and  4(A)  is  simply  A  b\.  Therefore, 
the  closed-loop  transfer  function  can  be  written  as  follows: 


U\)  = 


si  II(A  -  <*)  -  si  II(A  -  ft)l(A)  x  =  «A> A 


i=  1 


j= 1 


(6) 


where  51,32  G  ctj’s  are  the  zeros  of  4,  /3/s  are  the  (non-minimum  phase) 


zeros  of  4  and  [A,  62 ,  ci,  d12],  and  3(A)  =f  q(X)  bi  G  4*  Note  that  (1^4 


Also,  by  theorem  2.1,  <j>opt(\)  is  polynomial  in  A,  which  implies  that  qopt{\) 
is  polynomial  in  A.  Thus,  the  optimization  problem  is  equivalent  to  the 
following  linear  programming  (primal)  problem:  for  a  sufficiently  large  but 
finite  s, 


m.inX]  ^(*) 

<t>  i=0 


(7) 


s.t.  ^0(i)/?}  =  3i  n (0j  -  a,')  ,  j  =  1,2,. . .  ,r 

i= 0  t=l 

In  the  above  we  have  assumed  that  the  /?/s  are  simple  zeros  to  simplify  the 
formulation  of  the  interpolation  conditions.  The  coming  results,  however, 
carry  over  to  the  more  general  case. 

The  following  theorem  by  Deodhare  and  Vidyasagar  [4]  will  prove  useful. 
It  is  stated  with  no  proof. 

Theorem  4.1  The  support  of  in  (7),  denoted  as(s  +  l),  equals  the  number 
of  constraints  r,  if 

^]|ai|<1  (8) 

i= 0 

where  Ili=i(A  -  Pj)  =  Ar  +  ar_xAr_1  -f  •  •  •  +  «iA  +  a0. 


Now  we  are  ready  to  present  the  next  result. 


Theorem  4.2  Let  [A,  b2,  c\,  d-u]  have  r  non-minimum  phase  zeros ,  then  if 
(8)  is  satisfied,  f*  is  li-optimal. 


Proof  By  theorem  4.1,  (j>0pt{ A)  is  of  order  (r  —  1).  Then,  considering  the 
order  of  each  term  in  (6),  it  is  clear  that  qopt( A)  has  to  be  constant  and  such 
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that  <^(r)  =  0.  Using  the  state-space  formulas  (3),  (4)  and  (5), 


0  —  4>{r)  —  (ci  +  d\2  f*)Arf  1(Ab\  —  b2  9opt(0)) 

=  (ci  -f  d\2  f*)Arj,  a(A  —  b2  9<>pt(0))6i 

But,  by  construction,  (ci  +  d\2f*)A' ~f.  —  0  due  to  the  stable  pole-zero  can¬ 
cellations  and  the  fact  that  the  rest  of  the  poles  are  placed  at  the  origin. 
Therefore,  qopt  =  — /*  is  the  required  value,  and  kopt  —  f*  ■  I 

It  remains  to  consider  those  cases  where  the  non-minimum  phase  zeros 
of  [A,b2,ci,d12]  are  such  that  they  violate  condition  (8).  Theorem  4.1  es¬ 
tablished  only  a  sufficient  condition  to  determine  the  order  of  the  optimal 
response.  If  this  condition  is  violated,  the  optimal  closed-loop  response  might 
be  of  higher  order,  possibly  greater  than  n,  but  still  polynomial.  When  that 
is  the  case  the  following  theorem  applies. 

Theorem  4.3  If  the  optimal  response,  <^opt(A),  is  of  order  greater  than  n, 
then  the  ii-optimal  controller  is  necessarily  dynamic. 

Proof  The  highest  order  polynomial  response  that  a  static  controller  can 
generate  is  n,  by  placing  all  closed-loop  poles  of  the  plant  at  the  origin.  Any 
polynomial  response  of  order  greater  than  n,  say  N,  requires  a  dynamic  com¬ 
pensator  of  at  least  order  N  —  n.  I 

The  following  example  shows  that  a  large  class  of  state  feedback  singular 
problems  have  this  property. 

EXAMPLE  1:  Consider  the  following  parameterized  family  of  plants  (with 
parameter  k), 

Pl\)  V^-2.5A  +  1) 

"  1  (1  -  0.2A)(23A!  -  2.5A  +  1) 

Assume  that  the  controller  has  access  to  the  state  vector  and  that  the  distur¬ 
bance  acts  at  the  plant  input.  The  non-minimum  phase  zeros  relevant  to  this 
theory  are  given  by  the  roots  of  kA2  —  2.5A  +  1,  as  a  function  of  k.  It  is  easy 
to  see  that  for  k  >  3.5  condition  (8)  is  satisfied  and  the  optimal  controller 
is  /*.  By  applying  the  methods  of  [1],  it  can  be  shown  that  for  k  =  3.5  the 
optimal  solution  is  no  longer  unique.  Actually  two  possible  solutions  with 
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\4>opt\\x  =  7  are: 


A  -  2.5A2  +  3.5A3 
A  -  1.1A2  +  4.9A4 


^opt«= 3.5  — 

The  first  is  achieved  with  /*  while  the  second  requires  a  first  order  controller. 
(The  non-uniqueness  is  related  to  the  occurrence  of  weakly  redundant  con¬ 
straints  in  the  linear  program.)  Note  that  for  this  value  of  k,  the  left  hand 
side  of  (8)  is  equal  to  one. 

For  1.5  <  k  <  3.5  condition  (8)  is  violated  and  the  optimal  solution  has 
the  following  general  form: 

& opt i .5 < «<3 .5  —  A  4-  d>*.(2)A2  +  4>k(Nk) XNk 

As  k  \  1.5,  one  of  the  non-minimum  phase  zeros  approaches  the  boundary 
of  the  unit  disk  while  <j>K( 2)  — >  —1.5,  4>K(NK)  — »  0.5,  and,  most  remarkably, 
Nk  y  oo.  This  implies,  by  theorem  4.3,  that  the  optimal  controller  can  have 
arbitrarily  large  order.  For  instance,  if  k  —  1.51,  then 

-  A  -  1.4907A2  +  0.5776A12 

and  the  optimal  compensator  is  of  order  9.  It  is  also  interesting  to  point  out 
that  for  k  <  1.5  one  of  the  non-minimum  phase  zeros  leaves  the  unit  disk 
and  condition  (8)  is  again  satisfied.  In  this  case,  d,0ptK<1.5  =  A  —  1.5A2  and 
kopt  =  /*•  With  regard  to  the  optimal  norm,  it  drops  from  a  value  arbitrarily 
close  but  greater  than  3  to  a  value  of  2.5  in  the  transition. 

Similar  behavior  has  been  reported  in  [10],  for  the  case  of  sensitivity 
minimization  through  output  feedback.  The  above  example  shows  that  the 
nature  of  such  solutions  have  comparable  characteristics  even  under  full  state 
feedback. 


5  A  Non- Singular  Problem 

So  far  we  have  considered  problems  with  a  scalar  regulated  output.  One 
could  argue  that  sensitivity  minimization  problems,  such  as  the  one  in  the 
above  example,  where  a  measure  of  the  control  effort,  is  not  included  in  the 
cost  functional  (i.e.  singular  problems),  may  have  peculiar  solutions  that 
could  hide  the  structure  of  the  more  general  non-singular  case.  To  clarify 
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this  point,  we  will  consider  a  variation  of  the  above  example  by  including  the 
control  effort  in  the  cost  functional.  That  is, 


inf 

k~stab. 


fa 
i  fa 


=  inf  max{ ||& ||a  , 7  \\fa\h) 

k—stab. 


(9) 


where  4>\  represents  the  closed-loop  map  from  the  disturbance  to  the  output 
of  the  plant,  <f) 2  represents  the  closed-loop  map  from  the  disturbance  to  the 
control  input,  and  7  is  a  positive  scalar  weight.  The  fact  that  there  are 
two  regulated  outputs  and  only  a  scalar  control  makes  this  problem  of  the 
bad  rank  class  (see  [2]  and  [8]).  This  implies  that  a  linear  programming 
formulation  of  the  solution  will  have,  in  general,  an  infinite  number  of  non¬ 
zero  variables  and  active  constraints  (theorem  2.1  no  longer  holds)  making 
the  exact  solutions  difficult  to  obtain.  For  the  following  example,  however, 
it  can  be  shown  that  the  optimal  response  has  finite  support,  and  that  an 
exact  solution  can  be  computed  ([11], [5]). 

EXAMPLE  2:  Consider  problem  (9)  for  the  parameterized  family  of  plants 
of  example  1.  If  k  =  2  and  7  =  0.1  then  the  exact  f^-optimal  solution  can 
be  shown  to  be 


*,<A)  =  A  -  “I*  +  —A*  +  Mas 
;  558  558  558 


faW  —  — 


998.6 

558 


A  + 


11895.4 

558 


A2  + 


8955.4 

558 


A3  + 


1282.2 

558 


A4- 


708.4 
558  ' 


where  | j <^>1 1 1 a  =  7||^2||  =  1192/279  ~  4.2724,  and  the  optimal  controller  is 
dynamic  and  of  second  order. 

It  is  also  interesting  to  consider  the  singular  problem  corresponding  to 
this  example  (i.e.  k  =  2  and  7  =  0).  The  optimal  solution  is  given  by 


<MA)  =  A 


+  Ma« 

68  68 


=  -IMa  +  +  HHa*  -  MIas 


68 


68 


68 


68 


68 


where  || ^>1  Uj  =  286/68  ~  4.2059  while  || <^2 1| a  =  4374.4/68  ~  64.3294  is  clearly 
larger.  In  fact,  the  above  solution  is  valid  for  7  £  [0, 286/4374.4]  since  for  any 
7  in  such  interval  ||</>i||1  >  7  Moreover,  for  any  such  7,  the  C-optimal 
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controller  is  dynamic  and  of  second  order  since  the  optimal  <j>x  is  polynomial 
and  of  fifth  order. 

All  this  indicates  that  given  a  non-singular  problem,  the  optimal  con¬ 
troller  may  very  well  be  dynamic,  whether  or  not  the  two  regulated  outputs 
impose  conflicting  goals.  Further,  it  can  be  shown  that  even  when  the  corre¬ 
sponding  singular  problem  has  a  static  optimal  controller,  the  non-singular 
problem  may  require  a  dynamic  one. 


6  Concluding  Remarks 

This  paper  presented  a  study  of  the  (x  optimization  problem  for  systems 
with  full  state  feedback,  scalar  disturbance  and  scalar  control.  Two  classes 
of  problems  were  considered:  a)  singular  problems  with  a  scalar  regulated 
output,  and  b)  non-singular  problems  with  two  regulated  outputs,  one  of 
them  being  the  control  sequence.  The  main  purpose  of  the  study  was  to 
determine  whether  or  not  there  is  always  a  static  controller  which  is  lx- 
optimal.  First,  it  was  shown  that  for  a  large  class  of  relevant  problems 
the  lx -optimal  controller  is  necessarily  dynamic  and  that  the  order  of  the 
controller  can  be  arbitrarily  high.  Although  the  systems  in  question  were 
simple,  it  is  safe  to  conclude  that  more  complex  MIMO  state  feedback  lx 
optimization  problems  will  also  have  this  characteristic  in  general.  Second, 
it  was  shown  that  singular  problems  satisfying  equation  8,  which  only  involves 
the  non-minimum  phase  zeros  of  the  transfer  function  from  the  control  to  the 
regulated  output,  always  have  a  static  optimal  controller,  and  that  such  gain 
can  be  easily  computed  without  solving  a  standard  l\  problem. 
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